Support Engineering Group : 2012 Project Page
This page last changed on Jan 10, 2013 by kgomes.
5020-000 Books/Subscriptions Karen - Books $300.00
5020-000 Books/Subscriptions Mike - Books $166.01
5020-000 Books/Subscriptions Rich - Books $302.76
5020-000 Books/Subscriptions Rich - Experts Exchange Subscription $90.15
5020-000 Books/Subscriptions Thom - Books $353.37
5020-000 Books/Subscriptions Thom - Subscriptions $200.00
5060-000 Dues/Membership/Licenses Karen - AGU $20.00
5060-000 Dues/Membership/Licenses Mike - ACM & Digital Library $300.00
5060-000 Dues/Membership/Licenses Thom - Professional Membership $350.00
5130-000 OS - General Calibration $1000.00
5300-000 Supplies - Cmptr/Hdwr Mike - Misc Hardware $500.00
5300-000 Supplies - Cmptr/Hdwr Rich - Misc Hardware $12.25
5300-000 Supplies - Cmptr/Hdwr Karen $500.00
5300-000 Supplies - Cmptr/Hdwr Craig - Dev/Eval PCB (Encoder test) $1200.00
5310-000 Supplies - Cmptr/Sftwr Craig - TAP6 License Renewal $1300.00
5310-000 Supplies - Cmptr/Sftwr Kevin - iOS Developer License $100.00
5310-000 Supplies - Cmptr/Sftwr Karen - Misc Software $26.00
5310-000 Supplies - Cmptr/Sftwr Mike - Misc Computer Software $500.00
5310-000 Supplies - Cmptr/Sftwr Rich - VMWare License $25.00
5310-000 Supplies - Cmptr/Sftwr Rich - MonkeyBread Software 4 RB $150.00
5310-000 Supplies - Cmptr/Sftwr Rich - Einhugr 4 RB $50.00
5310-000 Supplies - Cmptr/Sftwr Rich - Frontline Serial Analyzer $275.00
5310-000 Supplies - Cmptr/Sftwr Rich - iOS Developer License $100.00
5310-000 Supplies - Cmptr/Sftwr Rich - Misc Software $80.06
5310-000 Supplies - Cmptr/Sftwr Thom - VMWare License $25.00
5310-000 Supplies - Cmptr/Sftwr Thom - RealBasic Renewal $532.00
5310-000 Supplies - Cmptr/Sftwr Thom - Frontline Serial Analyzer $275.00
5310-000 Supplies - Cmptr/Sftwr Thom - CCS v4 for DSP $3600.00
5310-000 Supplies - Cmptr/Sftwr Thom - IAR Update $2345.32
5310-000 Supplies - Cmptr/Sftwr Software Lab - Server Licenses (VMs) $776.13
5310-000 Supplies - Cmptr/Sftwr Software Lab - Misc Software Dev Tools $551.00
5310-000 Supplies - Cmptr/Sftwr SSL Certificates $600.00
5320-000 Supplies - Eng. Lab Support Lab - Supplies/Tools $1482.68
5320-000 Supplies - Eng. Lab Support Lab - Replace Lab Microchip ICD2 $500.00
5320-000 Supplies - Eng. Lab Support Lab - New Monitor $500.00
5330-000 Non-Capitalized Equipment Software Lab - Addtional RAM, DVD Burners, etc. $2798.78
5330-000 Non-Capitalized Equipment Software Lab - Misc Lab Supplies $1932.59
5330-000 Non-Capitalized Equipment Microwave and Wireless - License Renewal Fees $160.00
5330-000 Non-Capitalized Equipment Microwave and Wireless - Misc Supplies $2000.00
5360-000 Supplies - General Lab Supplies $375.47
5360-000 Supplies - General Thom - Carmel Robotics $100.00
Kevin
Project No. Title Allocated
(hours)
300057 Mooring Maint 20
708153 ESP MRI-R2 150
901009 CANON 680
901020 TTOS 25
901125 New Vessel 200
901201 EARTH 4
901212 Support Eng Upgrades 333
901207 Legacy Data 74
Thom
Project No. Title Allocated
(hours)
901009 CANON 688
901010 Distributed Autonomy 200
910200 AMP 160
901202 Resp. Upgrade 80
901219 Shallow Water FOCE 310
Mike
Project No. Title Allocated
(hours)
200105 Core Nav Data 80
200109 Core Mooring 120
901006 BEDS 100
901009 CANON 880
901111 AUV Infrastructure 128
901207 Legacy Data 279
901212 Support Eng Upgrades 150
Craig
Project No. Title Allocated
(hours)
300057 Mooring Maint 120
300058 DMO - WF 15
300079 DMO - RC 70
901007 Benthic Biology 40
901020 TTOS 20
901125 New Vessel 400
901200 AMP 120
901202 Respirometer Upgrade 440
901220 Midwater Ecology 40
Karen
Project No. Title Allocated
(hours)
300057 Mooring Maint 60
500055 Video Annotation DM 160
901009 CANON 200
901216 Ocean Chem 40
901219 Shallow FOCE 960
Rich
Project No. Title Allocated
(hours)
200103 Core CTD 160
200105 Core Nav 40
300057 Mooring Maint 140
300058 DMO - WF 40
300079 DMO - RC 40
701118 MARS 144
901125 New Vessel 400
901207 Legacy Data 206
901212 Support Eng Upgrades 333

Tracking

Here are some notes regarding work proposed for the Support Engineering Group for the year 2012.

Training ideas

This may be a good place for justification for training, so keep that in mind.

Support Engineering Group Proposal Ideas

  1. Data Processing Chain Solidification? (STOQS?)
    1. OA Moorings ? We are done.
  2. Workflow tool exploration?
    1. There is some opportunity to leverage some development activity within the CANON initiative to explore workflow tools and also provide some prototype functionality for the QoS tools exploration. The CANON data processing accomplishments over the last few years have built upon previous MBARI data management successes and is of sufficient maturity to make plans for capturing information about the processing such that this workflow information is treated as a "first class" product, just as the data are. Here is a diagram that depicts the capture of CANON data processing information.
  3. Offline data tools for WF GOC?
  4. Software Engineering Lab clean out (talk to Duane)? Take this off Karen's list?
  5. SVN upgrade/CVS? (share responsibility with I.S.?)
  6. O4 for OASIS/Hybrid upgrades
  7. Antennae platform is broken for WF on Mt. Toro
  8. ROV Control Computer upgrade examination(Ventana): if not part of cross decking.
  9. Cloud Exploration and analysis:
    1. Understanding systems like Turnkey (http://www.turnkeylinux.org/) and the pros and cons to enable folks at MBARI to start moving processing there.

NCV

  1. DMO will be putting in a proposal for this if the vessel is acquired.
  2. Talk to Steve and get trip planned.

Legacy System Transitions

I.S. needs to transition a list of machines and software to more modern foundations and will need help from Support Engineering whose applications are running on some of the platforms. Here is the list of platforms and what their target transitions will be. Also is the persons to be involved and the estimate of hours for each person to complete it.

HP-UX

Goal is to retire HP-UX machines, replace with RHEL Linux VMs (or physical machines where necessary)

System Purpose Notes Resources Hours
eclipse NIS master, NetApp master, NTP, 911/firealarm paging, IS cron tasks, WF mail staging, Psynch, sendmail alias maintenance   No Support Engineering Required 0
gr8white core data transfer and processing (NAV, CTD for PL, WF, Ventana, Doc Ricketts), NTP
  • Move to Linux VM
  • Install Perl 5
  • Make sure FTP is setup correctly
  • Move over all load scripts
  • Make sure rovctd account is active
  • Rich Schramm
  • Mike McCann
  • Kevin Gomes
  • 8 (RS)
  • 8 (MM)
  • 10 (KG) - documentation
gustnado ftp.mbari.org, mail gateway   No Support Engineering Required 0
lobos (Pt. Lobos) mail relay, NTP [move these functions to logger?] Will be part of the cross-decking of Ventana
  • Rich Schramm
 0
manta (Western Flyer) shipboard mail server, NTP, NetBackup catalog off-host disaster recovery [move these functions to seadog]   No Support Engineering Required 0
reef NTP, ICS BuilderXcessory, legacy development (Datamanager, tiburon)
  • Back up the directories (burn to CD) and then delete
 No Support Engineering Required 0
tsunami OASIS data collection/processing, NTP
  • Note that oasisa's home directory is local and will need to be moved
  • /oasis is a mount from tornado
  • Software will need to be recompiled for Linux
  • Documentation will be part of this too
  • Rich Schramm
  • Mike McCann
  • Kevin Gomes
  • 40 (RS)
  • 40 (MM)
  • 20 (KG) - documentation
Mac OSX

Goal is to retire PowerPC Macs, transition anything required to Linux VMs

System Purpose Notes Resources Hours
heckel Francisco's group; mbsystem (both already migrated off?)   No Support Engineering Required 0
jeckel SSDS and/or AUV data processing?
  • The idea with this replacement server is that we would start to consolidate all SSDS related processing on this machine
  • The auvportal code is run here. It is checked out out of CVS in ssdsadmin's dev directory and is installed in /usr/local/auv_ctd. There is a parallel installation for the Benthic Imaging vehicle in /usr/local/auv_bi. The transition to to a Linux VM should be relatively painless and involves:
    1. copying the /usr/local/auv_{ctd,bi} directories over
    2. changing the IP address in the upload scripts on the Dorado main vehicle computers
    3. finding and fixing any left over problems
  • Mike McCann
  • Kevin Gomes
  • 8
  • 10 (KG) - documentation
bob SSDS ingest This machine will be replaced by the combination of ssds.mbari.org and messaging.shore.mbari.org. Bob is being used for ingesting packets, storing them in a database and then forwarding them on to another JMS running on new-ssds (if necessary). I am going to mark this as zero hours and I am planning to have this change over done in 2011.
  • Kevin Gomes
  • Neil Conner
  • 0
  • 0
SQL 2008

Goal is to upgrade SQL 2000 to SQL 2008 (primarily replacing solstice with dione and another new VM); list below are the databases that would be affected

System Purpose Notes Resources Hours
BOG Support Francisco's BOG data store This will be the responsibility of Francisco's group No Support Engineering Required 0
Confluence Database to back the Confluence web application
  • This move will happen during an upgrade of Confluence and the database will be moved to dione
  • Kevin Gomes
  • 16
Crowd The database that backs the Crowd authentication mechanism
  • This should be the DB that is currently on Equinox and is using the newest crowd application running on crowd.mbari.org
  • Kevin Gomes
 2
DiveLog Database to back the dive log application for Kim R.
  • Rich contacted Kim to determine if the application is even being used and if not, it should probably just be archived and removed
  • As of this writing, I am assuming we have not received and answer, but will assume we are not migrating
  • Rich Schramm
 0
ENGDrawings  
  • These are mostly ASP pages
  • This is still actively being used
  • We should contact Dale Graves about usage and scoping
  • Changes should be documented
  • Mike McCann
 15
EXPD Database backing the EXPD application
  • This database has a lot going on: stored procedures, nightly jobs (nee DTS), asp scripts on typhoon.
  • We'll need a test system to make sure everything works. If it all works first time, then great - this won't take much time.
  • If not, there may be a lot of rework to do.
  • Documentation
  • SQL may not be that bad, Mike has been chipping away at the code moving away from DTS
  • Rich to do some re-org
  • Stored procedures and views should just move to new DB
  • The web part is a mixture of perl and ASP
  • Ideal would be to move web stuff to linux/perl/apache
  • Mike McCann
  • Rich Scramm
 40 to 240
Jira Database that backs the JIRA issue tracking web application
  • This move will be done during an upgrade of the JIRA application
  • Kevin Gomes
 16
SamplesDB Database to back the Samples web application
  • This database has a lot going on: stored procedures, linked tables to MS Access, nightly jobs (nee DTS), asp scripts on typhoon.
  • We'll need a test system to make sure everything works. If it all works first time, then great - this won't take much time.
  • If not, there may be a lot of rework to do. The EXPD transition will help us know where the issues are, so the time estimate is a bit less for this database
  • Like EXPD
  • Flavor of BOG with some access forms
  • Mike will be adding a column for some work for Eve L. before the migration
  • There are cron jobs on seaspray that load the samples DB
  • There are no DTS jobs
  • Mike McCann
  • Jenny Paduan
  • 40 to 80
MMB This is the database that backs the molecular database Rich built for ESP lab
  • Should talk to Chris Scholin as to the projected use of this (we don't foresee it being used)
  • We can just move it to the new server without replication
  • Should just move straight across
  • If the lab does continue to use it, the DBs on the laptops will need to be upgraded and replication reinstated (we are not scoping for this)
  • Rich Schramm
  • 8
SSDS Metadata and data database for the SSDS This was done in July of 2011 No Support Engineering Required 0
TMA Facilities database   No Support Engineering Required 0
IIS web servers

Goal is to build new VMs with Windows 2008/IIS 7, migrate sites to them

System Purpose Notes Resources Hours
sirocco external web site, LOBOVIZ, "where are the ships"  
  • Mike McCann
  • 8
typhoon internal web site, Expedition database, Waypoints, webcams, SamplesDB, 3Dreplay, Engineering Drawings
  • This will move to a new OS
  • Hence it will have a new IIS server
  • We should setup a "Test Typhoon" (new VM) and setup to point to foghorn, then Mike can test
  • Mike McCann
  • Rich Schramm
  • 20
  • 10
DNR's

These machines can't be upgraded/transitioned for various reasons, and per Francisco are to run until dead with no recovery, so we don't plan to transition them. Listed here in case there's something using them that needs to move elsewhere before they expire.

System Purpose Notes Resources Hours
surf (HP-UX) satellite data collection & processing     0
spongebob (Solaris) satellite data processing     0

Quality of Service tools exploration

Working with I.S. I want to start looking at some technologies or frameworks to help us monitor all aspects of the application stacks that we are trying to support. This would be everything from the networking layers (i.e. Nagios) all the way up to giving people hooks to advertise status of it's operation. This will be combined with I.S. Legacy upgrade work. Task might be:

  1. Initial Survey of Monitoring Frameworks and related technologies (40h Kevin, 20h Todd, 20h Pete)
  2. Exploration and prototyping of a couple candidates on core data stream processing (mooring) (120h Kevin, 20h Todd, 20h Pete)

Attachments:
Overarching Data Flow Diagram (text/xml)
Overarching Data Flow Diagram (text/xml)
Overarching Data Flow Diagram (text/xml)
Overarching Data Flow Diagram (text/xml)
Overarching Data Flow Diagram (text/xml)
Overarching Data Flow Diagram (text/xml)
Overarching Data Flow Diagram (text/xml)
Overarching Data Flow Diagram (text/xml)
Overarching Data Flow Diagram (text/xml)
Overarching Data Flow Diagram (text/xml)
Overarching Data Flow Diagram (text/xml)
Overarching Data Flow Diagram (text/xml)
Overarching Data Flow Diagram (text/xml)
Overarching Data Flow Diagram (text/xml)
Document generated by Confluence on Feb 03, 2026 16:22